1/9 





Recording a sequence of 




S110 - 


consecutive individual images 
K(t), t=1,...,nof a person 


— , 




*~ =, 

Selecting two consecutive individual 




S120 - 


images K(t-1) and K(t) from the 
sequence 

I * 












Does a comparison of tne inaiviauai ima 






ges K(t-1) and K(t) indicate intrinsic 




S130 - 


movements of the person between 
the two individual images 
K(t-1) and K(t)? 
a™* — * r 


It) 



Authenticity of the recor- 
ded images K(t-1) 
and K(t) has been verifieo| 



S170 



Authenticity of the recor- 
ded images K(t-1 ) and 
K(t) has not been verified! 

7 



S180 



S190 (optional) 



Fig. 1 
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S230iDetermining the differential image; D(t)=K(t)-K(t-1) 





optional 


S240- 


■ — 1 

Binarization: B 5 (t)=0(D(t)- 5) 








S250- 


Determining a region of enhanced 
movement in the differential image D(t) 
or the binarized differential image B(t) 








S260- 


Does the region of enhanced movement 
:orrespond to a predetermined region in which 
intrinsic movements are to be expected, e.g. 

mouth region a/v cheek region a/v nose 
region a/v eye region? 




S170 


\ no 

S180 



Fig.2 
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S230 or S240 



i 



Determining the function Y v of the products 
S350— I from the horizontal projections P H and the 
horizontal variances V H of D(t) or B(t) 



(11 

ill 
W 

m 



I* 

□ 



Determining the function Y H of the products 
S351 —| from the vertical projections Pv and the 
vertical variances V v of D(t) or B(t) 



S352 — 



S353- 



optional 



Smoothing with low-pass filter TPF: 
Yv -»TPF{Yv} 
Y H ->TPF{Y H } 



Peaks of Yv define vertical and peaks 
of Y H define horizontal extent and position 
of the region of enhanced movement 

1 

S260 



Fig.3 
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4) 

m 



S260 

_L 



Determining a further region of enhanced 
movement acc. to S250 or S350 to 
S461 —I S353, the region being expected to be in a 
symmetrical relationship with the 
region of enhanced movement from S260 



■r* 



S462- 



ls it possible to verify by means of a 
correlation analysis that the symmetrica] 
relationship exists? 



^ yes 
S170 



y no 
S180 



Fig.4 
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1 



S530-I 

L 


Determining the differential image: D(t)=K(t>K(t-1) J 




| optional 


SS40- 


Binarization: B 5 (t)=0(D(t)- 5) 






^ 




Determining the vertical position and extent 




S550- 


and the horizontal position and extent 
of the mouth region from D(t) / B(t) 





S560 



SS65- 



Is the determine 
within predetermi 


d mouth region 
ned boundaries? 


S170 and 

> 


or S180 


Does the presence of intrinsic movements 
i- in the mouth region follow from a correlation 
analysis of the mouth region? 



v y es 

S170 



y no 
S180 



Fig.5 
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S530 or S540 



1 



Determining the function Y v of the products 
S650— \ from the horizontal projections Ph and the 
horizontal variances V H of D(t) or B(t) 



Peak of function Yv defines vertical posi- 
S6S1 —| tion and vertical extent [t, b] of the 

mouth region 



S652- 



Determining function Yh ; [u>] of the products 

from the vertical projections Pv ; [t,b] and 
the vertical variances Vv ; [t f b] of D(t) or B(t) in 
the region of the vertical extent determined 
according to S651 



S653- 



Peaks of Y H; [t,b] define 
horizontal extent 
and position of the mouth region 



T 



SS60 



Fig.6 



S530 or S540, S650 to S 653 and SS60 

__i 



S766- 



Splitting up function Yv and/or Yh 
into sections which are expected to be in 
a symmetrical relationship(s) 
with each other 





1s it possible to verify by means of a 




S767- 


correlation analysis that there is/are 
symmetrical relationship(s)? 














S170 and 


or S180 






optional 






S768- 


splitting up function Y v and/or Yh -;■ 
into predetermined sections 

i 





S769- 



Is it possible to verify by means of a 
correlation analysis that the values of 
function Y v and/or Yh are substantially irregu 
lar in their definition range(s) or the 
predetermined sections? 



yes 

i 

S170 



no 



S180 



Fig.7 
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S120 - 



S110 

I- 

Selecting two consecutive 
individual images K(t-1) and K(t) from 
the sequence 



S82S - 



1 



Is the change between the individual 
images K(t-1) and K(t) within a 
predetermined range? 



yes 



and 



S826 - 



no 



/or 



Can at least one region in which intrinsic 
movements are expected be extracted 
from the individual images 
K(t-l) and K(t)? 



yes 



and 



no 



/or 



S827 — 



Can the individual images K(t-1) and K(t) 
be stabilized? 



yes 

S130,£230, S530 



no 



Fig. 8 



S120 prS825 

optional 



S920 — 



Is the change between the individual 
images K(t-1) and K(t) within a 
predetermined range? 



4 



S921 — jpetermining the differential image: D(t) - K(t) - K(t-1)| 



S922 — 



S923- 



S924- 



Determining the upper head boundary 






Determining the left and right head boundaries J 






Defining the lower head boundary by the head 
- boundaries determined acc. to S921, S922 
and S923 so that a square region is en- 
enclosed by the head boundaries 







S826 



Fig.9 



